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(57) Abstract: A Video-on-Demand Server architecture (100, 200, 300) transmits a plurality of pre-coded programs having different 
bit rates across a fixed bandwidth channel (11). Foreachprogram, a generator (120-1 2P- 1, 11 0. 210) generates a plurality of different 
bit rate representations for each program. Each generator also provides control information at each of a plurality of successive time 
windows T for each bit rate representation. The control information provides a bit rate and a quality measure during each time 
window T. The control information enables a statistical multiplexer ( 1 6, 160, 260) to select a bit rate representation for each program 
during each time window T to maximize the quality of the selected representations while not exceeding the total available channel 
capacity. 
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VIDEO ON DEMAND SERVER SYSTEM AND METHOD 
TECHNICAL FIELD 

This invention relates to a technique for efficiently providing video on demand while 
maintaining bandwidth constraints of a fixed channel. 

BACKGROUND ART 

Present day Video-on-Demand (VoD) systems typically transmit Constant Bit Rate 
(CBR) video. Transmitting CBR video does not achieve the same eifficiency as transmitting 
variable bit rate (VBR) video for eqxiivalent long-term average bit rates. Transmitting multiple 
pre-recorded VBR-encoded video programs over a constant bandwidth channel has problems 
since the sum of the instantaneous bitrates required by each program can sometimes exceed the 
total available bitrate. On the other hand, broadcast applications employing real-time encoders 
use statistical multiplexing to exploit the instantaneous bitrate variations between multiple 
programs being carried on the same carrier or transponder. The encoders operate in real time to 
enable the system to constrain the total combined bit rate for all programs so as not to exceed the 
channel capacity over a given time window. Each video program has an associated complexity 
measure. A central controller dynamically adjusts the bit rate allocated to each video program 
based upon the relative complexities. 

There now exist devices known as "video transraters" that operate to reduce the bit rate of 
video streams within a common compression standard, such as MPEG 2 for example. Present 
day transraters often experience difficulties when converting between constant and variable bit 
rates, Such transraters also can experience difficulties when trying to alter the bit rate for bit 
streams that have niany scene changes, or a large number of I-Pictures. 

Scalable video encoding, which permits dividing a video signal into a base layer and one 
or more enhancement layers, can also address bit rate issues. Several methods of scalable video 
encoding exist, including spatial, SNR, temporal, data partitioning, fine grain scalability (FGS), 
frequency scalability. The MPEG-2 and MPEG-4 video compression standards include several 
scalability methods. Using scalable encoding requires both the transmitter and receiver have the 
same ability to implement different coding algorithms, thus introducing additional complexity. 
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Thus, there exists a need for a technique for managing variable bit rate video on demand 
that obviates the disadvantages of the prior art, 

BRIEF SUMMARY OF THE INVENTION 

Briefly, in accordance with present principles, there is provided a method for transmitting 
a plurality of pre-coded programs having different bit rates across a fixed bandwidth channel. 
For each program, at least two, and preferably, a plurality of different bit rate representations are 
generated. Control information is provided at each of a plurality of successive time windows for 
each bit rate representation. The control information provides a bit rate and a quality measure 
during each time window. The control information enables selection during each time window 
of a bit rate representation for each program to maximize the quality of the selected 
representations while not exceeding the total available channel capacity in that time window. 

BRIEF SUMMARY OF THE DRAWING 

FIGURE 1 depicts a block schematic of first preferred embodiment of a Video-K)n- 
Demand server architecture in accordance with the present principles; 

FIGURE 2 depicts a block schematic of second preferred embodiment of a Video-on- 
Demand server architecture in accordance with the present principles; and 

FIGURE 3 depicts a block schematic of third preferred embodiment of a Video-on- 
Demand server architecture in accordance with the present principles. 

DETAILED DESCRIPTION 



Before proceeding to describe the technique of the present principles, the following 
terminology will prove helpful: 

T is the time interval over which the system optimization is being contemplated 

C is the total channel capacity available in time frame T 

P is the total number of programs 

p e (0, P-1), is the index of a particular program 

N[pJ is the total number of representations of program p 
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n[p] € (0> N[p] —1) is the index of a particular representation of program p 
r[p, x] is the bit/rate of representation x of program p during T 
q[p, x] is the quality of representation x of program p during T 

5 FIGURE 1 depicts a first preferred embodiment of a Video-on-Demand server 

architecture 10 in accordance with the present principles for transmitting pre-encoded CBR 
and/or VBR audio/video programs over a fixed bandwidth channel 1 1 having a total channel 
capacity, C. The server architecture 10 includes a plurality of multirate stream generators 12o, 
12i . , . 12/»-i, where P is an integer greater than zero corresponding to the number of separate input 

10 streams. The stream rate generators 12o-12p-i each pre-code a corresppnding one of the programs 
Program 0, Program 1 . . .Program P-1 at a plurality of different bit rates. Stated another way, 
each multirate stream generator pre-codes the corresponding program to yield at least two or 
more different bit rate representations. A representation can include a particular stored encoded 
bit stream, or a combination of various portions of different encoded bit streamis. A storage 

15 device 14, typically in the form of a single disc drive, a Redundant Array of Inexpensive Discs 
(RAID), or a plurality of RAIDs, serves to store the pre-coded representations generated by the 
multirate stream generators 12o-12p-7. 

Each of the multirate stream generators 12o-12p.i generates control information for each 
time window T of for the corresponding one of Programs 0 to P-i, respectively. The control 

20 information for each time window T for each representation of each program includes an 

indication of the bit rate of that representation and a quality measure, such as the peak signal-to- 
noise ratio (PSNR) of the representation. A central statistical multiplexer ("stat mux") 16 
receives the control information for each representation. At each successive time window T, the 
Stat mux 16 selects a representation for each program to maximize the quality of the transmitted 

25 programs while maintaining the total bit rate at or below the total capacity C of the channel 1 1, 
The lowest bit rate representation for each program should not exceed a prescribed value 
such that the sum of the lowest bit rates for all programs will not exceed the channel capacity for 
each interval T. In this way, at least one representation of each program can undergo 
transmission over the channel 1 1 . Requiring the lowest bit rate representation for each program 

30 to have a peak bit rate of C/P or less can achieve this constraint. Other methods exist that meet 
p-i 

the constraint ^ r[pfi] < C for all time windows T of all programs. Typically, advance 
knowledge does not exist as to when playback of particular programs will commence. Therefore, 
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enforcing capacity restraints becomes easiest by requiring that the bit rate limit of the lowest bit 
rate representation be the same for all time windows T of a particular program. 

The process for the maximization of the overall combined quality can occur in several 



different ways. In all cases, the constraint ^ r[p.n[p]] < C must remain met for all time 

p=0 



5 windows T of all programs. A minimax approach can satisfy the constraint by choosing n[pj for 
each /? e (0, P-l) to maximize the quality of the minimum quality program (i.e., minimizing the 
maximum distortion.) 

The minimax approach can be implemented by sorting the control information for each 
representation of each progfrnx so that the quality and bit rate index increases monotoxiically 

10 increasing with the index. The change in.bit rate for each step (referred to as the "delta (A)"bit 
rate) is then stored. The stat mux 16 begins with the lowest index for each program 
representation and computes the total capacity S. The stat mux 16 the selects the program 
representation at the lowest quality and checks if adding its delta bit rate to S exceeds C. If the 
addition of the representation does not exceed C, the index for that representation is incremented, 

15 and process is repeated. Once C is exceeded, the representation with the next to lowest quality is 
checked to see if adding its delta bit rate to S exceeds C. The process is repeated until no 
increment in any representation can be made without exceeding the channel capacity C. 
Alternatively, the total quality of all programs could be optimized by maximizing the sum of the 
individual program qualities which involves solving the following constrained optimization 

20 problem: 

subject to ^r[p,nlp]]<C 

It is also possible to optimize the product of the individual program qualities in the following 
manner: 

"^r^il^f'''"t/^3]' subject to ^r[p,n[p]]<C 

25 A weighted average can also be used, in order to provide different classes of service for different 
viewers. 

The multirate stream generators 12o-12p./ can use several different methods, or a 
combination of methods to form multiple representations of each program. In all cases, a random 
access point, such as an intra-coded (1) frame should occur at the beginning of each time window 
30 T, for each representation, so that for each time window T a different representation can be 
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chosen without causing drift. Each representation can use either CBR or VBR coding as long as 
the capacity of the lowest bit rate representation meets the total channel capacity constraint. 

In a first method, a multirate video encoder encodes each program at' several different bit 
rates into several independent bit streams. Each different bit rate bit stream serves as a different 
5 representation. FIGURE 2 depicts an architecture 100 for carrying out this method. As seen in 
FIG. 2, a multirate video encoder 1 10 serves to encode a corresponding program to yield a 
plurality of different rate representations. A separate one of transport packetizers 1 12o, 
1 122. . . 1 12p.i each packetizes a corresponding representation. The multirate encoding performed 
by the multirate encoder 110, and the packetization performed by the packetizers 1 12(r 1 12>.i 

10 occurs once, not necessarily^ in real time, prior to storage in a storage device 140 similar in 
construction to the storage device 14 of FIG. 1. 

Selection of the representations stored in storage device 140 for output in real time occurs 
in response to a signal received from a selector block 150. The selector block 150 identifies the 
stored representation for output in response to a request from the stat mux 160 for a particular 

15 representation. Upon receipt of the signal from the selector block 150, the storage device 140 
supplies the selected packetized representations to the stat mux 160 for output. 

In a second method, portions of the several different bit streams are combined to yield 
additional representations of a program. The presence of random access points at the same 
location in all bit streams of a program (as would naturally occur at scene changes) or the use of 

20 fixed group-of-pictures structures, permits the combination of compressed data from different bit 
rate streams at random access boundaries to form new representations. No need exists to store 
each representation independently, as long as the ability exists to generate each representation 
from the data that is stored. Consider the following example where T is one second, the data is 
coded at 30 ^s, and I frames are inserted every 15 frames, yielding three different bit rate bit 

25 streams, designated as Bit stream 0, Bit stream 1, and Bit Stream 2, respectively. Each bit stream 
constitutes a separate representation. An additional representation can be formed which uses 
Bitstream 0 for the first 15 frames and Bitstream 1 for the second 15 frames, and so on. 

Assuming alignment of the random access points with the transport packets, the server 
architecture 100 of FIG. 2 works well when the transport packetization occurs in advance. 

30 FIGURE 3 depicts a VoD server architecture 200 better suited when the random access points do 
not necessarily align with the transport packets. Referring to FIG. 3, VoD server architecture 200 
includes multirate video encoder 210 for generating a plurality of different bit rate 
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representations for storage in a storage device 240 similar to. thp storage devices 14 and 140. The 
representations stored in the storage device 140 exist as un-packetized bit streams. 

Selection of the representations stored in storage device 240 for output in real time occurs 
in response to a signal received from a selector block 250. The selector block 250, similar in 
5 nature to the selector block 150 of FIG. 2, identifies the stored representation for output in 

response to a request from a static mixer/multiplexer 260 for a particular representation. Upon 
receipt of the signal from the selector block 250, the storage device 240 supplies the selected 
packetized representations to the static mixer/multiplexer. Apacketizer 212 packetizes the 
output stream of the static mixer/multiplexer 260 for output on the channel (not shown). 

10 Representations also can be formed by switching between stored bit streams for non- 

reference pictures, such as for video codecs (not shown) that include pictures that are not used as 
reference pictures for predicting other pictures, such as MPEG-2 B frames or JVT non-stored 
pictures. Each non-reference picture can be selected from a different stored bitstream without 
affecting the quality of subsequently coded pictures, as the non-stored pictures are not used for 

15 prediction. Complete elimination of a non-reference picture in a representation can also occur. 
Each non-reference picture could be switched individually, or groups of non-reference pictures 
could be switched together, allowing for many possible total bit rate representations. The 
multirate stream signal generators 12(rl2p.j of FIG. 1 can choose to limit the number of possible 
representations to send to the stat mux 16 of FIG. 1 to choose those with significant differences 

20 in quality and bit rate. It is not necessary for each representation to be independently stored in 
storage, but a table listing the. location and length of each coded frame can be stored to simplify 
generation of the representation when needed. It is also possible to store multiple bit rate bit 
streams only for the non-stored pictures and only store a single version of the reference (I and P) 
pictures, which can significantly reduce storage requirements. 

25 With the VoD server architectures ICQ and 200 of FIGS. 2 and 3, respectively, the stat 

mux 160 and the static mixer/multiplexer 260 generate a bit stream corresponding to the selected 
representation. If individual pictures are not transport packet aligned, the architecture 200 of 
FIG. accomplishes transport packetization after the generation of the bit stream for a particular 
representation. Otherwise, the VoD server architecture 100 of FIG. 2 FIG. 2 will work well. 

30 In accordance with another aspect of the present principles, scalable video coding can 

occur by the use of a scalable video encoder (not shown) to form a base layer and one or more 
enhancement layers. Any type of scalability that which employs the base layer for motion 
compensated reference picture prediction in order to avoid drift can be used, such as frequency 
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scalabiUty. FGS. SNR scalability or temporal scalability. The lowest bit rate representation 
corresponds to the base layer. The peak bit rate of the base layer must be such that when the bit 
rates of all programs' base layers are summed, the channel capacity C is not exceeded for each 
time window T. Other higher bit rate representations will correspond to the base layer plus some 
5 portion of the enhancement layer. This approach requires that the video decoder support the type 
of scalability used. The VoD server architecture 100 of FIG. 2 is used upon inclusion of an entire 
enhancement layer in a particular representation. The VoD server architecture 200 of FIG. 3 is 
used if portions of an enhancement layer are used in a representation. 

For systems which use encryption for contents right management, the VoD server 
10 architecture 100 of FIG. 2 does not require any decryption or encryption in real time, as 
encryption is added to the transport packetization process done in non-real time and entire 
encrypted transport packets are stored and transmitted. The VoD server architecture 200 of FIG. 
3 requires that encryption be performed along with transport packetization in re^-time. 

VoD programs generally include both audio and video. As audio bit rates are generally 
significantly lower than video bit rates and are also generally at a fixed bit rate, there is less 
advantage to be gained by selecting from different pre-encoded audio bit streams by the stat mux 
16 and 160 of FIGS 1 and 2, and the static mixer/multiplexer 260 of HG. 3. A user likely will 
find the switching of audio quality during the viewing of a single program disturbing. The total 
channel capacity C can be considered to be totally consumed by the video channel; assuming that 
a single bit rate audio stream is also sent for each program. Alternatively, the above-described 
methods can also be applied to audio, where multiple representations of audio programs with 
different bit rates and qualities can be generated. 

A video player (not shown) that works with the VoD server architectures of the present 
principles will contain a video decoder (not shown) and some storage for buffering. For the 
particular program being received, the data can arrive at a non-unifoim data rate, but with the 
requirement that the data corresponding to time unit T wiU arrive any time within the T time 
window. The video player must have the capability of buffering and delaying for T. An upper 
limit on the maximum bit rate that can be transmitted for a given representation of a program for 
a time window T can be pre-determined to limit the decoder complexity and decoder buffer size. 
The decoding buffer is generally a requirement of a video decoder, e.g. MPEG-2 levels sets 
buffer size particular requirements, and the combination of T and die bitrate may be chosen to 
meet it. 



wo 2004/025405 



PCTAJS2003/028275 



-8- 

Fast forward and fast reverse tracks for each program can also be stored at the VoD 
server. They can be stored at a single bit rate, or at several different bit rates, and allowed to 
adapt as is done for the normal play program. 

Detennmation of the time window T length is based on several factors. T should be as 
5 large as possible to get the most statistical multiplexing gain, but smaU enough to constrain the 
delay at the video player for start-up and switching between normal play and trick play streams. 
T should be small enough to meet decoder requirements. 

The foregoing describes a system and method for efficiently providing video on demand 
while maintaining bandwidth constraints of a fixed channel. 
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CLAIMS 



1 I. AmeU,odfor.r»smitf„gapl„,3liC'ofpreK,c<iedprogran«aavi„gdUre«mbi. 

2 rates across a fixed bandwidth channel, comprising the Steps of: 
generadng at least two different bi, rate tepresentations of each program- 
providing control infonnadon at each of a plutality of successive time windows T for 

each representation of each program, the control infonnation for each successive window 
indicating a bit rate and quality measure for a t^resenution of a corresponding program, and 

dunng each time window T, selecting a n=p,esentatton for each program such to 
maximize the quality of the lelected reptesentations while no. exceeding a «,tal available 
9 capacity for the channel. 



2- ^"^^*°*^^^^°'ding to claim 1 wherein the step of generating at least two 

2 efferent bit rates representation fimher comprises the step of generating for each program a 

3 lowest bit rate representation having a peak bit rate not greater than C/P where C is the total 

4 channel capacity in time T and P is the total number of programs. 

3. The method according to claim 1 wherein the step of providing the control 
infonnation further comprises the step of establishing the peak signal-to-noise mio (PSNR) as 
the quality measm-e embodied in the control information. 

4. The method according to claim 1 wherein the selecting step further comprises die 
step of selecting a representation for each program which meets the constraint 

p-\ 

2 «[/»]] ^ C for all time windows wherein- 

C is the total channel capacity available in time frame T; 
P is the total number of programs; 
p e (0, P-l\ is the index of a particular program; 
mpj is the total number of representations of program p\ 

n[p] 6 (0, N[p] -I) is the index of a particular representation of program/,; and 
r[p. X] is the bit rate of representation x of program p during T 
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1 5. The method according to claim 4 further comprising the step of choosing each 

2 program's representation n[p] e (0, N[P]tl) to maximize the quality of the program p that had 

3 the minimmn quality. 

1 6. The method according to claim 5 further comprising the steps of: 

2 (a) sorting, the quality information for with the bit rate and quality measure monotonically 
. 3 increasing with an index value; 

4 (b) storing each bit rate increment (delta) and quality value for each index value; 

5 (c) beginning with a lowest index value, computing total capacity S for program 

6 representations selected thifS far for such index value; 

7 (d) selecting a program representation at a lowest quality measure; 

8 (e) checking whether the bit rate increment of the selected program at the lowest quality, 

9 when added to the representations selected thus far, exceeds total channel capacity, and if not 

10 (f) increriienting the index value; and 

1 1 (g) repeating steps (c)-(f), 

1 7. The method according to claim 1 wherein the selecting step further comprises the 

2 step of selecting the representation for each program such to maximize a sum of individual 

p-i p-i 

3 program qualities by solving max ^ q[p, n[/;]]; subject to r[p, n[/7]] < C 

4 wherein , 

5 C is the total channel capacity available in time frame T; 

6 P is the total number of programs; 

7 P € (0, P'l\ is the index of a particular program; 

8 N[p] is the total number of representations of program p\ 

9 n[p] € (0, N[p] -1) is the index of a particular representation of program p; 

10 r[p, x] is the bit rate of representation x of program p during T; and 

1 1 q[p, x] is the quality of represenUtion x of program p during T. 

1 8. The method according to claim 1 wherein the selecting step further comprises the 

2 step of selecting the representation for each program such to maximize a product of individual 

3 program qualities by solving { 
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max 



Yl^^P'^^P'^y^ subject to ^rip,n[pJ]<C 



P=0 / . p=0 



5 where, 

6 C is the total channel capacity available in time frame T; .. . 

7 P is the total number of programs; 

8 /? € (0, P-1), is the index of a particular program; 

9 N[p] is the total number of representations of program p; 

10 n[p] e (0, Nfp] —1) is the index of a particular representation of program p; 

11 r[p, x] is the bit rate of representation x of program p during T; and . . - . 

12 q[p, x] is the quality of repifesentation x of program p during T. 

1 9. The method according to claim 8 further comprising the step of applying a 

2 weighted average to provide different classes of service for different viewers. 

1 10. A system for transmitting a plurality of pre-coded programs having different bit 

2 rates across a fixed bandwidth channel, comprising the steps of: 

3 means for generating at least two different bit rate representations of each program; 

4 means providing control information at each of a plurality of successive time windows T 

5 for each representation of each program, the control information for each successive window 

6 indicating a bit rate and quality measure for a representation of a "corresponding program; and 

7 means for selecting during each time window T a representation for each program such to 

8 maximize the quality of the selected representations while not exceeding a total available 

9 capacity for the channel. 

1 11. The system according to claim 10 wherein the generating means and control 

2 information providing means collectively comprise: 

3 a plurality of multirate stream generators, each associated with a corresponding one of the 

4 plurality of pre-coded programs. 

1 12. The system according to claim 10 wherein the generating means and control 

2 information providing means collectively comprise: 

3 a multirate video encoder for encoding at least two bit rate representations of each pre- 

4 coded program. 
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1 13. The system according to Claim 10 Wherein the generating means and control 

2 information providing means collectively comprise: 

3 a multiiate video encoder for encoding at least two bit rate representations of each pre- 

4 coded program; and 

5 a plurality of ti^sport packetizers, each serving to packetize the bit rate presemations for 

6 each pre-coded program. 

1 14. The system according to claim 10 wherein the selecting means includes a static 

2 multiplexer. • 

1 15. The system according to claim 12 wherein the selecting means comprises: 

2 a static multiplexer; and 

3 a transport packetizer for packetizing the selecting representation. 

/ ^ system according to claim 10 wherein the selecting means generates for each 

2 program a lowest bit rate representation having a peak bit rate not greater than C/P where C is the 

3 total channel capacity in time T and P is the total number of programs. 



1 17. The system according to claim 10 wherein control information providing 

2 establishes quality measure in accordance with a peak signal-to-noise ratio (PSNR). 



means 



1 18. The system according to claim 10 wherein the selecting means selects a 

p-i 

S 

p=0 



2 representation for each program which meets the constraint %r[p,nipj] < Cfor all time 



3 windows where: 

4 C is the total channel capacity available in time frame T; 

5 P is the total number of programs; 

6 p e (0, P-1), is the index of a particular program; 

7 N[pJ is the total number of representations of program p; 

8 n[p] G (0, NfpJ -1) is the index of a particular representation of program p; and 

9 r[p, x] is the bit rate of representation x of program p during T. 
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1 19. The system according to claim 18 wherein the selecting means chooses each 

2 program's representation n[p] e (0, N[P]-1) to maximize the quality of the program p that had 

3 the minimum quality. 

1 20. The system according to claim 10 wherein the selecting means selects the 

2 representation for each program such to maximize a sum of individual program qualities by 

3 solving: 

4 niax2^9[/7,/z[/7]]; subject to Y r[p,n[/7]] < C 

5 where, • 

6 C is the total channel capacity available in time frame T; 

7 P is the total number of programs; 

8 /? € (0, P-1), is the index of a particular program; 

9 N[p] is the total number of representations of program p; 

10 n[pj e (0, N[pJ -1) is the index of a particular representation of program p; 

1 1 r[p, x] is the bit rate of representatioii x of program p during T; and 

12 q[p, x] is the quality of representation x of program p during T. 

1 21. The system according to claim 10 wherein the selecting means selects the 

2 representation for each program such to maximize a product of individual program qualities by 

3 solving: 

p-i • P-I ^ 

4 TnaxYlq[p,n[pJ\; subject to T r[/?,n[p]] < C 

P=o ^ 

5 where, 

6 C is the total channel capacity available in time frame T; 

7 P is the total number of programs; 

8 p € (0, P-1), is the index of a particular program; 

9 N[pJ is the total number of representations of program p; 

10 n[p} € (0, N[p] -1) is the index of a particular representation of program p\ 

11 r[p, x] is the bit rate of representation x of program p during T; and 

12 q[p, xj is the quality of representation x of program p during T. 
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1 22. The system according to claim 10 wherein a weighted average is applied to 

2 provide different classes of sendee for different viewers, 

1 
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ABSTRACT OF THE DISCLOSURE 

/ 

A Video-on-Demand Server architecture (100, 200, 300) transmits a plurality of pre- 
coded programs having different bit rates across a fixed bandwidth channel (1 1). For each 

5 program, a generator (12o-12p-7, 110, 210) generates a plurality of different bit rate 

representations for each program. Each generator also provides control information at each of a 
plurality of successive time windows T for each bit rate representation. The control information 
provides a bit rate and a quality measure during each time window T. The control information 
enables a statistical multiplexer (16, 160, 260) to select a bit rate representation for each program 

10 during each time window Tto maximize the quality of the selected representations while not 
exceeding the total available channel capacity. 
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